Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache only required fields when computing statistics #792

Merged
merged 3 commits into from
Jan 30, 2024

Conversation

JulienPeloton
Copy link
Member

IMPORTANT: Please create an issue first before opening a Pull Request.
Linked to issue(s): Closes #782

What changes were proposed in this pull request?

Only cache relevant fields (which are not many!) when computing statistics.

How was this patch tested?

CI

@JulienPeloton JulienPeloton added bug Something isn't working statistics labels Jan 18, 2024
@JulienPeloton JulienPeloton added this to the 3.2 milestone Jan 18, 2024
* Use filter for SIMBAD statistics

* Use fink-utils definition of list of extragalactic sources. Closes #630

* Fix missing import

* Cast numpy array into list for Spark operation
Copy link

Quality Gate Passed Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

@JulienPeloton JulienPeloton merged commit edffb06 into master Jan 30, 2024
18 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working statistics
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Statistics OOM
1 participant